On the Advantages of a Systematic Inspection for Evaluating Hypermedia Usability

It is indubitable that usability inspection of complex hypermedia is still an "art", in the sense that a great deal is left to the skills, experience, and ability of the inspectors. Training inspectors is difficult and often quite expensive. The SUE inspection technique has been proposed to help usability inspectors share and transfer their evaluation know-how, to simplify the hypermedia inspection process for newcomers, and to achieve more effective and efficient evaluation results. SUE is based on the use of evaluation patterns, called Abstract Tasks, which precisely describe the activities to be performed by evaluators during inspection. This paper highlights the advantages of this inspection technique, by presenting its empirical validation through a controlled experiment. Two groups of novice inspectors have been asked to evaluate a commercial hypermedia CD-ROM applying the SUE inspection or the traditional heuristic technique. The comparison was based on three major dimensions: effectiveness, efficiency, and satisfaction. Results have shown a clear advantage of the SUE inspection over the traditional inspection on all dimensions, demonstrating that Abstract Tasks are efficient tools to drive the evaluator's performance.